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FOREWORD 



The study presented herein was performed by the General Electric Space Division, 

Valley Forge, Pennsylvania, for the NASA Goddard Space Flight Center under contract 
NAS 5-20906. The study was performed in three phases: 

1. Phase A - Study on Component Environmental Specification Development and 

Test Techniques. 

2. Phase B - Study on Development oF Cost Effective Alternate Approaches to 

Creating Shuttle Spacelab Payload Environmental Test Requirements. 

3. Phase C - Continued Study on Development of Cost Effective Alternate 

Approaches to Creating Shuttle Spacelab Payload Environmental 
Test Requirements. 

The principal investigator was Harold R. Gongloff and the Program Manager was Clyde 
V. Stable. The NASA technical monitors were W. Brian Keegan and Joseph P. Young, 
who provided valuable guidance throughout the course of this study. 

The results of Phases A and B were presented in the three-volume report, "Vibroacoustic 
Test Plan Evaluation", GE Document No. 76SDS4223, June 1, 1976. The results of Phase 
C are presented in this report. 
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SUMMARY 


t 


This report presents the results obtained from the Phase C portion of this study to 
optimize Shuttle Spacelab payload vibroacoustic test requirements such that design 
defects can be corrected in a cost effective manner. In this portion of the study 
the statistical decision models developed during the Phase B portion of the study 
were modified and used to evaluate the cost effectiveness of seven new alternate 
vibroacoustic test plans and to determine the optimum test levels associated with 
each plan. The test plans included no testing, component testing, subassembly test- 
ing, or payload testing and combinations of component and subassembly testing or 
component and payload testing. Protoflight components were considered at all levels 
of testing since it was shown during the Phase B portion of the study that the use 
of prototype components was not cost effective. Two structural test options, either 
no structural test or protoflight structural test, were considered for the new test 
plans be:ause during the Phase B portion of the study the use of a prototype Structural 
Development Model increased the expected costs. 

The methodology developed during Phase B was modified for the Phase C study. A 
decision model is used to evaluate the expected cost of a shuttle payload program using 
the alternate vibroacoustic test plans. The environment during ground testing and 
flight is represented as a log normal distributed random variable, including spatial 
variations evaluated during the Phase A portion of the study and flight to flight 
excitation variations estimated during the Phase B portion from launch vehicle acoustic 
measurements. The vibroacoustic strength of payload components is also treated as a 
log normal distributed random variable using the results of previous studies. Using a 
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stress-strength type of statistical analysis, the probabilities of component failures 
during ground testing and flight are estimatef', considering the vibroacoustic test 
program to significantly change the component strength distribution. The effect of 
the vibroacoustic test environments on the component strength accounts for cumulative 
damage and incipient failures. These probabilities are then used to establish the 
probability of achieving a completely successful or partially successful flight 
using a reliability model of the payload at the component level of assembly. By 
combining che probabilities of flight and vibroacoustic test failures with their 
estimated costs the expected program cost is estimated. The decision model treats 
the vibroacoustic test levels as parameters to facilitate the determination of the 
best vibroacoustic test plan and the associated test levels. 

Except for the modifications described in this report, the simplications and assumptions 
made to develop the methodology during Phase B apply also to the Phase C study. A 
flight by flight evaluation of the flight failure probability was made during Phase C 
to obtain a more accurate representation. From this evaluation a single mission 
reliability equivalent to the average reliability over NF missions was obtained. The 
cost of designing components for increasing vibration levels was formulated as a 
function of the vibration test level and was included in the Phase C study. 

Sensitivity analyses were performed to evaluate the effect of some potentially critical 
parameters on the optimum expected program costs and the associated vibroacoustic 
test levels. The parameters that were made variable were: 

1. The shuttle payload bay internal acoustic environment 

2. The STS launch cost per flight 
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3. The degree of redundancy in the components of the housekeeping section of 
the payload reliability model. 

4. The retest/ repair cost of components that fail during ground testing 
and flight. 

A total of 196 cases were studied during Phase C, seven conditions (a revised base- 
line and six variations) for seven test plans and four payload configurations. 

The optimum vibroacoustic test levels that provided the minimum expected project cost 
were determined and the vibroacoustic test plans were ranked according to cost and 
reliability. Except for the less complex payload configurations, the test plan cost 
rank for the revised baseline, starting with the plan that yielded the lowest 
minimum cost, was: 

1. Subassembly testing only 

2. System testing only 

3. Component and subassembly testing 

4. Component and system testing 

5. No testing 

6. Component and protoflight structure testing 

7. Component testing only 

For the less complex payload configurations rankings 5 and 6 were reversed. Large 
variations occurred in the optimum expected project cost obtained for the parameter 
variations of the vibroacoustic test plans; the largest variation was $5.3 million. 
The lowest cost approach eliminated component testing >and maintained a high flight 
vibroacoustic reliability by performing subassembly tests at a relatively high 
acoustic level. To realize the indicated cost saving, new contractual relations 
are needed to obtain the required support from the component suppliers. 
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For the parameter variations considered in this study the vibroacoustic test plan 
cost and reliability rankings, the optimum expected project costs, and the associated 
test levels vary with the test plan, payload, and parameter being varied. The most 
sensitive parameters were the shuttle payload bay internal acoustic environment 
and the STS launch cost. The optimum expected project costs and the associated test 
levels increase as the shuttle payload bay internal acoustic environment and the STS 
launch cost increase for all test plans and payload configurations. The optimum expected 

I 

project iosts and the associated component vibration test/design level increase as the 
component retest/repair cost for failures that occur during assembly level testing and 
flight increases, but the associated assembly acoustic test level varies with the test 
plan and payload. As the degree of redundancy in the housekeeping section of the pay- 
load increases the optimum expected project cost increases, but the associated test 
levels decrease. 

The methodology is now developed to the point that optimum expected project costs 
and the associated test levels can be achieved for each alternate vibroacoustic test 
plan considered. It is recommended that more sensitivity analyses be performed to 
evaluate the effects of other parameters. To facilitate such analyses, the computer 
codes that were written during Phase B and Phase C should be reviewed, coordinated, 
optimized, and documented so that more people can utilize them to examine methods of 
reducing program costs for specific payload configurations. 
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SECTION 1 


INTRODUCTION 


The objective of this Phase C portion of the study is to continue the development of 
cost effective alternate approaches to creatinq Shuttle Spacelab payload vibroacoustic 
test requirements. Previous studies have indicated that statistical decision models 
provide a viable method of evaluating the cost effectiveness of alternate vibro- 
acoustic test plans and the associated test levels. The methodology developed in this 
study provides a major step toward the development of a realistic tool to quantitatively 
tailor test programs to specific payloads. Testing is considered at the no test, 
component, subassembly, or system level of assembly. Component redundancy and partial 
loss of flight data are considered. Most direct and probabilistic costs are considered 
and incipient failures resulting from ground tests are treated. Optimums defining 
both component and assembly test levels are indicated for the modified test plans 
considered in this portion of the study. Modeling simplifications must be considered 
in interpreting the results relative to a particular payload. New parameters in- 
troduced to this portion of the study were a no test option, flight by flight failure 
probabilifleb, and a cost to design components for higher vibration requirements. 
Parameters varied for this study were the shuttle payload bay Internal acoustic 
environment, the STS launch cost, the. component retest/repair cost, and the amount 
of redundancy in the housekeeping section of the payload reliability model. 

The Phase C portion of the study was expanded beyond the consideration of a typical 
payload subjected to a prescribed sh;ittle environment. The shuttle payload bay 
internal acoustic environment (145 dB uA) of the STS Payload Accomnodatlons document, 
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Reference 1, was applied as the baseline environment. The sensitivity of the 
results to this parameter was examined by considering alternate acoustic environments 
of 135 dB OA and 150 dB OA. Cost variability and redundancy variations were also 
examined. 

To perform these parameter studies, the mathematical models developed for Phase B, 
Reference 2, were modified. The statistical estimates of flight failure probabilities 
were improved by developing a method to calculate flight by flight failure probabilities 
in order to obtain a single mission reliability equivalent to the average reliability 
over NF missions. The cost effectiveness of a no-test option was evaluated by adding 
a new test plan. Other test plans were modified so that protoflight components were 
used at all levels of assembly. Another new item was the cost associated with design- 
ing hardware to vibration levels in excess of those normally used with conventional 
spacecraft. 

Statistical decision theory was applied to the evaluation of seven vibroacoustic 
test plans. All test plans evaluated during both Phase B and Phase C are given in 
Table 1-1. Test Plans 1 through 5 were evaluated during Phase B. Test Plans 4 
through 9 were considered in this Phase C study. 

The following sections of this report present the results of the Phase C study. 

The modifications made to the matheinatical models of Phase 6 are presented in Section 
2. The considerations made for the parameter variations are discussed in Section 3. 

The Phase C results are presented in the test ^ilan evaluation given in Section 4. The 
conclusions and recommendations are presented in Section 5. 


Table 1-1 

Vibroacoustic Test Plan Matrix 


Test Plan 
No. 


Component 

Test 


Subassembly 

Test 


System 

Test 


Structure 

Test 


Protofl i ght 


SDM** 

Protoflight 
Protoflight Protofl 1 ght 
Protofl Iqht SDM 


Protofl 1 ght 


Protofl Iqht 
Protoflight Protoflight 


Protoflight 
Proto flight 
Protofl 1 ght 
Protofl 1 ght 


Protoflight 


Protofl 1 ght 


Protofl loht 


Protoflight I Protoflight 


* Prototype housekeeping components and protoflight experiment components 
** Prototype Structural Development Model 


NOTE: Test Plans 1 - 5 were considered In the Phase B study. 
Test Plans 4-9 were considered In the Phase C study. 
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SlCTION 2 


) 


MODEL REVISIONS 

The objective of the Phase C study was to generalize the investigation performed 
in the Phase B study, Reference 2, to inc’ude the effects of the acoustic environment 
and of critical parameter variations on alternate vibroacoustic test plans and the 
associated test requirements. To accomplish this a modified set of test plans was 
used, investigations of design costs and flight by flight failure probabilities were 
performed, and key parameters were varied. The modified test plans are discussed in 
Section 1. The variation of key parameters is discussed in Section 3. The desigi, 
cost and flight by flight failure probabilities are discussed ir. this section. The 
decision models developed in Phase B were modified to include these revisions. 

2.1 DESIGN COST 

The cost of designing components tc higher vibration levels is difficult to estimate. 
Early discussions with packaging engineering led to the conclusions that the design 
work normally done for existing components would be performed using different load 
factors and may cause some minor changes in packaging methods, but did not appear to 
be appreciable. The primary increases in costs were felt to be encountered during the 
test phase when failures which require modifications of the equipment occur. This 
redesign/ retest cost was not included in the Phase B study, but was added to the Phase 
C study. 

The design cost as a function of the component vibration test/design level was in- 
vestigated further from the program manager and component vendor points of view. 

As the component vibration requirement is increased, there is obviously an increased 
risk of problems arising during the test phase If methods of Increasing the dynamic 
design adequacy of the package are not Incorporated. This implies that a program 
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manager responsible for component development would either allow additional design 
time or additional test time to account for anticipated vibration problems. A 
quantification of the component design cost as a function of the component vibration 
level was developed after discussions with program managers and component vendors. 

To obtain this quantification the following considerations were made: 

1. For a component vibration requirement of 10 g rms, there is no design cost. 

2. For a component vibration requirement of 40 g rms, there is a design 
cost of $10,000 per component. 

3. For an extreme component vibration requirement of 100 g rms, the design cost 
becomes extremely high. 

Fitting an equilateral hyperbola to these three points yields the equation expressing 
the expected cost (in thousands of dollars) of designing components to higher vibration 
levels, E as a function of the component vibration test/design requirement, g. 

E = 1800 - 20. 10 < g < 100 (2-1) 

TUiri'g - 

For this study an upper bound of $160,000 was established for component vibration re- 
quirements above 90 g rms. 

Equation (2-1) gives the cost, in thousands of dollars, for a single component. This 
design cost was included as an additional direct cost to the cost models of all the 
test plans. The effects of the design cost are evident on the optimum cost graphs. 
Figures 4-1 to 4-28, The pronounced Increase in the expected cost at the higher g 
levels is a direct result of the design cost, particularly for those test plans (Test 
Plans 4, 5, 6) which have no testing at the component level of assembly. The most 
significant effect of the design cost is that, for Phase C, optimum costs and the 



associated test levels are obtained for all test plans. This was not achievable for 
Test Plans 4 and 5 of the Phase B study. 


2.2 FLIGHT BY FLIGHT FAILURE PROBABILITIES 

The purpose of this consideration was to obtain a single mission reliability equivalent 
to the average reliability over NF missions. For Phase B the flight failure probabilities 
were determined by using vibration reliabilities for the components that were based on 
an average exposure duration over the total number of flights 

(tp = 15 m i ssions * 8 s ec/ m i s _ s i o n. ^ gQ sec.). In this Phase C study an investigation 

was made to determine if a flight by flight estimate could be used to improve the re- 
presentation. Using the transformation of the component strength to account for 
cumulative damage, the strength can be determined as a function of the cumulative flight 
exposure duration. Each of the transformed strength curves can then be used in a stress- 
strength analysis to determine the probability of a failure for a selected value of the 
cumulative flight exposure. 


The method of transforming the strength distribution was presented in Section 3 of 
Reference 2. For Phase C the following expression is employed to calculate the flight 
by flight data. 


P 


3 

ST 


where 




[p5 + (i-i) 

M 


( 2 - 2 ) 


transformed assembly test pressure 

pressure associated with the assembly acoustic test level 


P 


variable pressure 
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P = mean pressure 
M 

tp = individual mission flight time 
= 8 seconds per flight 

tg = assembly test time 
= 120 seconds 

I = number of flights 
= 1 ,2a . . . , 15 

The vibration reliabilities obtained by applying Equation (2-2) represent the individual 
flight failure probabilities. The mean pressure is used to account for the expected 
damage from the previous flights. Vibration reliability data for 2 component vibration 
test levels, 8 assembly test levels, and 3 shuttle acoustic envir'^iments were obtained 
for Test Plan 9. The average vibration reliability was determined for 15 missions. In 
all cases this average value occurred between 7 and 8 missions. These data are presented 
in Tables 2-1, 2-2, and 2-3 for the 145, 135, and 150 dB environments, respectively. 

In these tables the accunanulated flight time, AFT, is given for each of the 15 missions. 

The data for the 145 dB environment were then evaluated to obtain the average vibration 

reliability after 1, 2 15 missions and obtained the single mission that would 

satisfy the average for each case. From this analysis a pattern evolved and was 
,’eneralized for the 1 to 15 mission data to yield the following relationship between 
the number of missions planned for the given payload (NF) and the equivalent single 
flight number for which the vibration reliability data are calculated. 

Flight number = [Integer part of (NF/2)] + 1 (2-3) 

Equation (2-3) was applied to obtain the equivalent single flight number (8) that 
was used to evaluate the 15 missions (NF) Shuttle Soacelab payload considered in the 
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Phase C study. 


/ 


The models for all test plans were revised to include the above flight by flight 
considerations to obtain the flight failure probabilities. Vibration reliability 
data were obtained for 9 component vibration test/design levels, 8 assembly test levels, 
and 3 shuttle acoustic environments for Test Plans 4, 6, 7, 8 after each level of 
testing. Note that the vibration reliability data for Test Plans 4, 7, and 8 also 
apply to Test Plans 5, 7B, and 9, respectively. This constitutes the basic data used 
to establish the probability of achieving a completely successful or partially 
successful flight. By combining the appropriate probabilities of flight and test 
failures with the various cost models, the expected program costs were estimated. 
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SECTION 3 


I 


PARAMETER STUDY 

After the model revisions described in Section 2 were completed, a parameter study 
was made to determine the effects of the acoustic environment and of key parameter 
variations on alternate test plans and the associated test requirements. First, 
data for a revised baseline were obtained. Then the following parameters were 
varied: 

1. Shuttle payload bay internal acoustic environment 

2. STS launch cost 

3. Degree of redundancy in the housekeeping section 

4. Component retest/repair cost 

A total of 196 cases were studied, seven conditions (baseline and 6 variations) for 
4 payloads for 7 test plans. For each case data fcr the- assembly test level yielding 
the minimum total expected cost of failure (TECF) were selected for the test plan 
evaluation. These items are discussed in the following subsections. To identify the 
data for the variations a case code, which is described in Section 3.1, was established. 

3.1 CASE CODE 

In order to identify the data generated for the 196 cases in the parameter study, a 
six-digit case code for the Phase C analysis was established. Each digit represents 
a particular parameter: 

1st digit - Test Plan ID 

1 » TP-4, Test Plan 4 

2 - TP-5, Test Plan 5 

3 " TP-6, Test Plan 6 

4 - TP-7, Test Plan 7 

5 - TP-7B, Test Plan 7B 

6 ■ TP-8, Test Plan 8 

7 • TP-9, Test Plan 9 
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2nd digit - Payload ID 

1 * 1,2 Payload 1,2 

2 = 1 ,6 Payload 1 ,6 

3 = 7,2 Payload 7,2 

4 = 7,6 Payload 7,6 

3rd digit - Shuttle Payload Bay Internal Acoustic Environment ID 

0 = Baseline 

1 = 1st Variation 

2 = 2nd Variation 

4th digit - STS Launch Cost ID 

0 = Baseline 

1 = 1st Variation 

2 = 2nd Variation 

5th digit - Degree of Redundancy in Housekeeping Section ID 

0 = Baseline 

1 = 1st Variation 

6th digit - Component Retest/Repair Cost ID 

0 = Baseline 

1 * 1st Variation 


This case code was used throughout the Phase C analysis and is used in this report. 

It is the value given in the key to the symbols of the curves cn the optimum cost 
graphs. Figures 4-1 to 4-28. The values used for the variations are given in the 
appropriate subsection. The test plans, given in Table 1-1, are described in Section 

1. The payload ID gives the number of experiments (NEXP) and the number of components 

I 

peculiar to an experiment (NCPE). For example, Payload 7,6 is the payload configuration 
; that has 7 experiments with 6 components in each experiment. 


In the discussion given in Section 4 a four-digit number is used in some places to 
indicate the variation being discussed. This number is the last four digits of the 
basic six-digit case code. 
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In this study only one parameter was varied at a time, so that in each case either 
three or four of the last four digits in the case code are zero. The following 
examples demonstrate the use of the case code. 

1. 110000 - baseline data for Payload 1,? of Test Plan 4. 

2. 231000 “ data for the first shuttle payload bay internal acoustic environment 

variation for Payload 7,2 of Test Plan 5. 

3. 320200 - data for the second STS launch cost variation for Payload 1,6 of 

Test Plan 6. 

4. 440010 - data for the first degree of redundancy variation for Payload 

7,6 of Test Plan 7. 

5. 630001 - data for the first component retest/repair cost variation for 

Payload 7,2 of Test Plan 8. 

3.2 REVISED BASELINE 

As a result of the model revisions described in Section 2, the computer programs 
developed to compute the probabilities and expected costs were changed. A significant 
portion of these programming changes was due to the modified group of test plans 
discussed in Section 1. The test plan changes for Phase C were as follows: 

1. The addition of a no- test option (Test Plan 6). 

2. The elimination of prototype components. 

3. The testing of protoflight components at all levels of assembly. 

4. The elimination of Structural Development Model (SDM) testing. 

As in Phase B, Section 4.6 of Reference 2, the strength of the primary structure was 
considered to be influenced sionificantly by the selection or a design safety factor. 
Two design options were considered for the primary structure. In Test Plans 6 and 7 
no structural test was considered and a design safety factor of 2.0 was used to assure 





a high structural reliability. In the remaining test plans of Phase C a protoflight 
structural test was used with a design safety factor of 1.5 to minimize the 
probability of failing the flight structure during testing at limit load. The flight 
reliabilities for the structure are summarized in Table 3-1. The probability of 
failures during proto flight structural testing was 0.04. 

3.3 SHUTTLE PAYLOAD BAY INTERNAL ACOUSTIC ENVIRONMENT 

The 145 dB shuttle payload bay internal acoustic spectrum of the STS Payload 
Accommodations document, Reference 1, was considered to represent the mean plus 2 
sigma acoustic level as for Phase B, Section 2.1 cf Reference 2. The shuttle payload 
acoustic environment is not completely defined; it depends on a number of factors 
such as the launch pad configuration, orbiter payload ooor structural configuration, 
door seal attenuation and the effects of vents. Current predictions vary from the 
145 dB of the STS Payload Accommodations document. For Pha''*’ C the effects of the 
shuttle acoustic environment were examined by considering it as a variable covering 
a range about the current projections. The variation selected is representative of 
reductions that may be achieved by providing environmental controls and of increases 
that may be encountered due to prediction inaccuracies and unexpected phencruena. The 
variations considered for the Phase C study are: 

1. Baseline - 145 dC OA 

2. 1st Variation - 135 dB OA 

3. 2nd Variation - 150 dB OA 

The effects of the shuttle payload bay internal acoustic environment are discussed in 
detail in Section 4.31. 
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Table 3-1 


Structure Reliability During Flight 


Test 

Plan 

Safety 

Factor 

Flight 

Reliability 

Remarks 

1 

2.00 

0.99927 

No structural test 

lA 

1.25 

0.99875 

Prototype SDM 

2 

1.50 

0.999997 

Protoflight 

3 

1.50 

0.999997 

Protoflight as part of 
system test 

3A 

1.25 

0.99875 

Prototype SDM 

4 

1.50 

0.999997 

Protof 1 i ght 

5 

1.50 

0.999997 

Protoflight as part of 
system test 

6 

2.00 

0.99927 

No structural test 

7 

2,00 

0.99927 

No structural test 

7B 

1.50 

0.999997 

Protoflight 

8 

1.50 

0.999997 

Protof 1 i ght 

9 

1,50 

0.999997 

Protoflight as part of 
system test 
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3.4 STS LAUNCH COST 


The expected cost of flight failures includes the cost of incurring the loss of mission 
objectives during flight and the subsequent cost of refurbishing the payload after 
flight. The loss of data from each experiment is weighted equally so that a loss of 
a portion of the experinients during flight causes a corresponding portion of the single 
mission cost to be attributed to fligi't failures. 

The cost of a complete loss of data is estimated to be equal to the cost of thf» flight. 
The flight cost attributable to this payload is estimated to be approximately 25 percent 
of the STS launch cost per flight, Section 5.2.5 of Reference 2. For Phase B the STS 
launch cost per flight was fixed at $13,500,000. In view of the current projections, 
for Phase C the effects of the STS launch cost per flight were examined by considering 
it as a variable representative of the current estimates for government or commercial 
launches The variations considered for the Phase C study are: 

1. Baseline - $13,500,000 per flight 

2. 1st Variation - $17,500,000 per flight 

3. 2nd Variation - $21,500,000 per flight 

The effects of the STS launch cost are discussed in Section 4.3.2. 

3.5 REDUNDANCY IN HOUSEKEEPING SECTION 

The probability of achieving the flight objectives is needed to determine the cost of 
flight failures. A component flight failure does not general '.y result in a complete 
loss of the payload. To determine the expected cost of a flight failure, the reliability 
model developed for Phase B, Section 4.7 of Reference 2, is used to estimate the 
probability of achieving a pori.ion of the flight objectives. 






> 


I 



The reliability model represents the payload system- as a series of redundant components 
and a group of parallel experiments. The series components represent the basic sub- 
systems used for housekeeping functions and are essential to the success of the flight. 
Each experiment is composed of a number of series components. Parameters of the model 
are the following; 

NEXP = number of parallel experiments 
NCPE = number of components peculiar to an experiment 
NCCE = number of components coimion to all experiments, 
including the structure 

Representative values for these parameters used in this study are: 


NEXP = 1 and 7 
NCPE = 2 and 6 

NCCE = 17 (including the structure) 


For Phase B the series of housekeeping components was considered to have singTe 
redundancy and the series of experiment components did not include any redundancy. 

For Phase C the effects of the degree of redundancy in the housekeepino section were 
examined by considering it as a variable. Again, no redundancy was considered for the 
components in the experiment section of the payload. The changes in the reliability 
due to chanoes in the degree of redundancy are demonstrated in Figure 3-1. In this 
figure the parameter RVC is the reliability of the component having no redundancy. 

■^he vibroacoustic reliability of the series components can be written as 
NCCE 

n (R ) = (RVS) (3-1) 

1 C i 


where R^, 

RVS 

RV 


vibroacoustic reliability of a housekeeping component 
flight reliability of the structure 

vibroacoustic reliability of a redundant housekeeping component 
values given in Figure 3-1 
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~ tRVC(2.-RVC)t — 


(a) Single Redundancy 



RVC(3.-3.*RVC+ RVr 


(b) Double Redundancy 



f— = — f RVC(4.-6.*RVC+4.*RVC^- RVC^ 


(c) Triple Redundancy 


Example RVC = 0.9 
Rg = 0.99 

Rj, = 0.999 

R = 0.9999 
c 


Figure 3-1 Improving Reliabilities by Using Redundancy 








The cost programs for all test plans v/ere modified to handle degrees of redundancy of 
0, 1, 2, 3. The variations considered for the Phase C study are: 

1. Baseline - single redundancy 

2. 1st Variation - double redundancy 

The effects of the degree of redundancy are discussed in Section 4.3.3. The cost of 
purchasing the additional components when the degree of redundancy is varied was not 
included in this study. 

3.6 COMPONENT RETEST/REPAIR COST 

In accordance with present practices, any test or flight failure results in redesign 
and retest, so that the tests serve as a screen to remove marginal designs or hardware 
from the payload system. Testing at the component level of assembly is performed as 
a parallel project activity and the cost of component retest/redesign is based on the 
probability of a component failing the test. Subassembly testing is considered to be 
a parallel project activity for all payload subassemblies and for all but one experiment. 
Failures during subassembly testing are considered to be worked on a component basis 
using costs similar to those used for component testing. Failures during payload 
testing are considered to result in project schedule slippage with the related cost of 
the project team. The cost is related to the number of failures which occur with 
additional cost increases due to retesting at the component level of assembly. If a 
component malfunctions during flight, the payload is considered to be refurbished prior 
to the next flight. Payload refurbishment due to component failures is considered 
to consist of an additional functional test and the retest/repair of components at the 
component level of assembly. 


H 


The cost of redesigning and retesting a component after a failure occurs may increase 
during the assembly test and flight phases. Support from the component supplier may 
be required so that the cost is higher than it is during the component test phase. 

For Phase B this cost was fixed for all levels of testing. For Phase C the effects 
of the component retest/repair cost were examined by considering it as a variable 
covering a range of the current estimates. The variation selected is representative 
of the costs that may be incurred for failures occurring during the various test phases 
and flight. 

The variations considered for the Phase C study are: 


Baseline 

Failure during component testing 

$15,000 

Failure during assembly testing 

$15,000 

Failure during flight 

$15,000 

1st Variation 

• 

Failure during component testing 

$15,000 

Failure during assembly testing 

$30,000 

Failure during flight 

$40,000 


The effects of the component retest/repair cost are discussed in Section 4.3.4. 
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SECTION 4 


TEST PLAN EVALUATION 


The results obtained from applying the modified decision models to the seven vibro- 
acoustic test plans of Phase C are presented and discussed in this section. The 
section is divided into three parts. The results obtained for the Phase C study 
are presented in Section 4.1. The revised baseline data are discussed in Section 
4,2. The effects of the parameter variations are discussed in Section 4.3. 

4.1 PHASE C RESULTS 

The decision model for each test plan was exercised for four payload configurations. 

The payloads were of the facility type having 15 planned flights. The payload com- 
plexity was varied by considering either one or seven experiments. Each experiment 
was comprised of either two or six components. The housekeeping section of the pay- 
load was not changed and consisted of three subassemblies having a total of 16 re- 
dundant components and the structure. 

Data were obtained for the 196 cases defined in Section 3.1. The identification of 
the data was aided considerably by the use of the case code described in Section 3.1. 

The values for the varied parameters are given in Tables 4-1 to 4-7 for the seven 
vibroacoustic test plans considered in Phase C. Each of these tables has four parts, 
one for each payload. For each payload values are given for each variation. Values 
are given for the case code, the mean plus 2 sigma sound pressure level of the shuttle 
payload bay internal acoustic environment, the STS launch cost, the degree of redundancy 
in the housekeeping section of the payload, and the retest/repair costs for failures 
that occur during test at the component and assembly levels of testing and during 
flight. 
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For each case the component vibration test/design level in g rms and the assembly 
acoustic test level in dB were varied. The range of the component level was fixed 
in terms of the standardized vibration variable, Uy*, nine values were selected. 

The range of the assembly level was fixed in terms of the mean, v, and the standard 
deviation, o, of the acoustic environment; eight values were selected. The results 
are given in the Addendum. The total of the expected costs of failures and the direct 
costs, TECF, expressed in millions of dollars, and the flight failure probability, 

FFP, i.e., the probability of losing experiment data during flight, are presented. 

The optimum data given in the TECF tables are summarized in Tables 4-1 to 4-7 for 
the seven test plans considered in Phase C. Each table gives the data for each 
variation of the four payload configurations studied. Values are given for the optimum 
expected cost in millions of dollars. The standardized vibration variable, the 
component vibration test/design level, in g rms, and the assembly acoustic test level, 
in dE, at which the optimum cost occurs are given. Also given are the associated 
vibroacoustic flight failure probability and flight reliability; the sum of these two 
parameters is 1.0. 

The TECF data for the assembly test level at which the optimum cost occurs are shown 
in Figures 4-1 to 4-28. These figures show the expected cost in millions of dollars 
versus the component vibration test level or design level in g rms. Each figure shows 
the seven variations for one test plan/payload combination. The symbols used on the 
curves are identified accor^^ing to the six-digit case code presented in Section 3.1. 

The data plotted on these figures were taken from the expanded TECF tables discussed 
in the Addendum. Note that optimum vibration test levels are clearly evident for all 
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Figure 4-3 Costs for Optimum Acoustic Test Levels 
Test Plan 4, Payload 7,2 


4-12 



- 140000 

- 141000 

- 142000 



Fiqure 4-4 Costs for Optimum Assembly Acoustic Test Levels 
Test Plan 4, Payload 7,6 
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Figure 4-5 Costs for Optimum Assembly Acoustic Test Levels 
Test Plan 5, Payload 1.2 
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FI pure 4-6 Costs for Optimum Assembly Acoustic Test Levels 
Test Plan 5, Payload 1,6 
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Figure 4-12 Costs for Optimum Assembly Acoustic Test Levels 
Test Plan 6, Payload 7,6 
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Fiaure 4-13 Costs for Optimum Assembly Acoustic Test Levels 

Test Plan 7, Payload 1,2 
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Figure 4-14 Costs for Optlmtim Assembly Acoustic Test Levels 
Test Plan 7, Payload 1,6 
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Figure 4-20 Costs for Optimum Assembly Acoustic Test Levels 

Test Plan 7B, Payload 7,6 
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Flqure 4-21 Costs for Optimum Assembly Acoustic Test Levels 

Test Plan 8, Payload 1,2 
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Figure 4-23 Costs for Optimum Assembly Acoustic Test l( Is 
Test Plan 8, Payload 7,2 
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Figure 4-25 Costs for Optimum Assembly Acoustic Test Levels 

Test Plan 9, Payload 1 ,2 
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Figure 4-27 Costs for Optimum Assembly Acoustic Test Levels 

Test Plan 9, Payload 7,2 


36 



I 




s 


s 


s 


SSI 


o 
o 

O M 
cr^ 

CO 
z 
o 

^1 


0-r1 
o 

UJ 

all 

o -»1 

X 
Ul 


s 


S 



- 740000 

- 741000 

- 742000 

- 740100 
. 740200 

- 740010 

- 740001 


\(f — I — rnrTTTmtf — i — rmrrn? — t — r"rrrnT\cr 

COnPONENT VIBRATION TEST LEVEL. 0 RBS 


Figure 4-28 Costs for Optimum Assembly Acoustic Test Levels 
Test Plan 9, Payload 7,6 
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test plans. In Phase B optimum vibration levels were not attair'»ble for Test Plans 
4 and 5 and "optimum" data given for these test plans was for a representative 
component design strength associated with a component vibration test level of 
approximately 13 g rms. 

4.2 REVISED BASELIN E 

For Phase B the emphasis was placed on the development of the methrdology and a set 
of values was selected for the parameters. An extensive pictorial presentation of 
data was given in Section 6 of Reference 2. Graphs of costs, cost elements, and 
flight failure probability were shown or the evaluation of the 7 vibroaroustic tost 
plans of Phase B for the 4 payload configurations considered. The optimum results 
were summarised by test plan and payload in Tables 6-1 and 6-2, respectively, of 
Reference 2. Since several modifications have been made to the decision models used 
to evaluate the test plans, it is deemed necessary to present here a di* ssion of 
the revised baseline data. An extensive pictorial presentation is not made here for 
the revised baseline. The TECF and FFP data are given in the Addendum and the TECF 
data for the assembly test level at which the optimum cost occurs are shown ■'n Figures 
4-1 to 4-28. The case code for the baseline data is XYOOOO, where X is the test plan 
ID and Y is the payload ID defined in Section 3.1. On the figures the symbol for the 
baseline data is Q .A summary of the re'*ised basdline optimum data by payload 
is given in Table 4-8. Also given is the cost rank and the reliability rank. 

A comparison of the expected costs given in Table 4-8 Indicates that Test Plans 4, 5 
and 8 are the most attractive. Minimum cost (rank * 1) is achieved with Test Plan 
4, which involves subassembly testing only, for all of the payload configurations 
considered. Test Plan 5, which involves system testing only, ranks second, followed 
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by Test Plan 8, which involves component and subassembly testing, and Test Plan 9, 
which involves component and system testing. Test Plan 7, which involves component 
testing only, ranks last. The rankings of Test Plans 6 and 7 vary with the payload. 

For Payloads 1,2 and 1,6 Test Plan 7B ranks fifth and Test Plan 6 ranks sixth; 
these rankings are reversed for the other two payloads. 

The optimum component vibration test/design level varies from 20 to 26 g rms for 
Test Plan 4, from 31 to 35 q rms for Test Plan 5, from 45 to 59 g rms for Test Plan 
6, from 35 to 48 g rms for Test Plans 7 and 7B, from 13 to 16 g rms for Test Plan 
8, and from 21 to 24 g rms for Test Plan 9. The lowest component vibration levels 
are obtained for Test Plan 8, followed by Test Plan 4 or 9, Test Plan 5, Test Plans 
7 and 7B, and Test Plan 6, which has the highest component vibration levels. 

The optimum assembly acoustic test level varies from 151 to 153 dB for Test Plans 4 
and 8, from 145 to 149 dB for Test Plan 5, and from 147 to 151 dB for Test Plan 9. 

The lowest assembly acoustic test levels are obtained for those test plans that utilize 
system bestir’' Test Plans 5 and 9, and the highest assembly test levels are obtained 
for those te'_.. plans that utilize subassembly testing, Test Plans 4 and 8. 

The payload flight vibroacoustic reliability associated with the optimum cost is also 
given in Table 4-8 for the revised baseline. In this study, the flight vibroacoustic 
reliability is defined as the probability of no data loss from the payload as a result 
of a vibration failure of a component. For all payload configurations the test plans 
that utilize subassembly testing. Test Plans 4 and 8, rank 1, 2. The test plans 
that utilize system testing. Test Plans 5 and 9, rank 3,4. Test Plans 7B, 7, and 6 
rank 5, 6, and 7, respectively. 
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For all payload configurations a cost saving of $800,000 is achieved when protoflioht 
structural testing. Test Plan 7B, is used instead of no structural testing, Test Plan 
7. 


A comparison of the test plan cost rankings of the baseline for Phases B and C is 
given in Table 4-9. In both phases subassembly only testing ranks first, system only 
testing ranks second, component and subassembly testing ranks third, component and 
system testing ranks fourth, and component only testing ranks last. For Phase B 
component, system and SDM testing ranks fifth and component and SDM testing rarvks 
sixth. For Phase C either no testing or component with protoflight structure testing 
ranks fifth or sixth. 

A comparison of Table 4-8 with Table 6-2 of Reference 2 shows that, for comparable 
test plans, the optimum costs for Phase C are less than the optimum costs fcr Phase 
B and, in general, the associated test levels of Phase C are lower than those of Phase 

B. The main reason for the lower costs is the deletion of the direct cost of procur- 
ing prototype components for the vibration testing at the component level of assembly 
in Test Plans 1, lA, 2, 3, and 3A of Phase B from the comparable test plans of Phase 

C. The component vibration test levels for Test Plans 4 and 5 of Phase C are hioher 
than those of Phase B. The reason for this is that true optimum vibration test levels 
are obtained for Phase C, whereas for Phase B no true optimums were attainable and 
values were given for vibration test levels associated with a representative component 
design strength. 

The effects of variations in four key parameters are discussed in Section 4.3. That 
discussion compares the data for each variation with the baseline data discussed in 
this section. 
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4.3 PARAMETER VARIATIONS 

A parameter study was performed to determine the effects of key parameter variations 
on the evaluation of the seven vibroacoustic test plans. This section discusses the 
results obtained for varying the following key parameters: 

1. Shuttle payload bay internal acoustic environment 

2. STS Launch cost 

3. Degree of redundancy in the housekeeping section 

4. Component retest/repair cost 

The effects of these parameter variations on the cost ranking, optimum expected costs, 
optimum component vibration test/design levels, optimum assembly acoustic test levels, 
and vibroacoustic reliability ranking are discussed. 

4.3.1 SHUTTLE PAYLOAD BAY INTERNAL ACOUSTIC ENVIRONMENT 

Two variations of the shuttle payload bay internal acoustic environment were con- 
sidered. The first variation was 135 dB, which is 10 dB below the baseline value of 
145 dB; the second variation, 150 dB, is 5 dB above the baseline value. The third 
dig.t of the six-digit case code identifies the shuttle paylnad bay internal acoustic 
environment. The case codes for the data of these variations are XYIOOO and XY2000 
for the 135 dB and 150 dB environments, respectively, where X is the test plan ID 
and Y is the payload ID defined in Sections 3.1. The TECF and FFP data are given 
in the Addendum and the TECF data for the assembly test level at which the optimum 
cost occurs are shown in Figures 4-1 to 4-28. On the figures the symbols for these 
variations are O and A for the 135 dB and 150 dB environments, respectively. 

The environment is included in the title of the TECF and FFP data. Summaries of the 
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optimum data by payload are qiven in Tables 4-10 and 4-11 for the 135 dB and 150 dB 
environments, respectively. 

A comparison of Tables 4-10 and 4-11 with Table 4-8 shows that variations in the 
environment have the most significant effect on the cost rankings. For the 135 dB 
environment there are two rank changes for Payloads 1,2 and 1,6 and three rank changes 
for Payloads 7,2 and 7,6. For Payload 1,2 the rankings of Test Plans 7B and 9 are 
affected: for Payload 1,6, Test Plans 6 and 7B; for Payload 7,2, Test Plans 6, 7B, 
and 9; for Payload 7,6, Test Plans 6, 8 and 9. For the 150 dB environment there are 
two rank changes for Payloads 1,2, 1,6, and 7,2 and three rank changes for Payload 

7.6. For Payload 1,2 the rankings of Test Plans 5 and 8 are affected; for Payload 

1.6, Test Plans 6 and 7; for Payload 7,2, Test Plans 6 and 7B; for Payload 7,6, Test 
Plans 6, 7, and 7B. For the 135 dB environment Test Plan 4 ranks first for all pay- 
loads, Test Plan 5 ranks second for all payloads, and Test Plan 7 ranks last for all 
payloads. For the 150 dB environment Test Plan 4 ranks first for all payloads. 

Test Plan 7B ranks fifth for all payloads, and Test Plan 9 ranks fourth for all 
payloads. 

The optimum expected costs for the 135 dB environment are lower than the baseline 
costs in all cases. The amount of the decrease varies with payload and test plan 
from $0.256M for Payload 1,2 with Test Plan 4 to $3.547M For Payload 7,6 with Test 
Plan 6. In all cases the smallest decrease is obtained for Test Plan 4, followed 
by Test Plans 8, 5, 9, 7B, 7, and 6, which has the largest decrease. 

The optimum expected costs for the 150 dB environment are higher than the baseline 
costs in all cases. The amount of the increase varies with payload and test plan 
from $0.220M for Payload 1,2 with Test Plan 4 to $5.274M for Payload 7,6 with Test 
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Table 4-10 


Summary of Optimums By Payload 
Variation 1000 
Phase C 135 DB Environment 


Payload 

Test 

Plan 

Expected 

Cost 

($ X 106 ) 

Component 
Vibration 
Test/Oesign 
Level 
(g rm) 

Assembly 

Acoustic 

Test 

Level 

(dB) 

Associated 

Vibroacoustic 

Reliability 

Cost 

Rank 

Reliability 

Rank 

1,2 

4 

0.732 

12.619 

141 

0.99918 

1 

1 
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0.99851 

2 

3 


6 
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27.155 

- 

0.99571 
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12.619 

141 

0.99430 

1 
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8.603 

141 

0.99202 

3 

2 


9 

1.934 

12.619 

135 

0.98365 

6 

4 

7.6 

4 

1.052 

13.451 

141 

0.98392 

1 

1 


5 

1.257 

19.732 

135 

0.97153 

2 

3 


6 

2.261 

23.946 

- 

0.93407 

3 

5 


7 

3.848 

19.732 

- 

0.91813 

7 

7 


78 

3.055 

19.732 

- 

0.9188C 

6 

c 


8 

2.459 

9.775 

141 

0.97876 

4 

2 


9 

2.812 

13.451 

137 

0.96723 

5 

4 
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Table 4-11 

Summary of Optimums By Payload 
Variation 2000 
Phase C 150 DB Environment 


Payload 

Test 

Plan 

Expected 

Cost 

(S X 10^) 

Component 
Vibration 
Test/Design 
Level 
{r rms) 

Assembly 

Acoustic 

Test 

Level 

(dB) 

Associated 
Vibroanoustic 
Rel iabi 1 i ty 

Cost 

Rank 

! 

P.eliabilityi 

Rank 

1 

U2 

4 

1.208 

23.963 

158 

0.99815 

1 

1 : 


5 

1.947 

35.152 

154 

0.99585 

3 

3 I 


6 

5.064 

62.455 

- 

0.94541 

6 

7 1 


7 

5.151 

18.375 

- 

0.96439 

7 

6 ; 


7B 

4.343 

48.375 

- 

0.96509 

5 

5 1 


8 

1.923 

17.413 

158 

0.99797 


2 ! 


9 

2.802 

25.543 

154 

0.99548 


4 1 

1.6 

4 

1.605 

30.937 

158 

0.99511 

mm 

1 

2 ! 


5 

2.438 

37.470 

156 

0.99264 


3 1 


6 

9.582 

66.573 

- 

0.36816 


7 i 


7 

7.926 

62.455 

- 

0.93323 


6 i 


7B 

7.092 

62.455 

- 

0.93396 


5 ! 


3 

2.450 

18.561 

160 

0.99659 


1 


9 

3.403 

29.023 

156 

0.99244 

mM 

4 ! 

7.2 

4 

1.476 

22.480 

156 

0.97305 

1 

1 1 


5 

2.284 

35,152 

152 

0,95579 

2 

3 I 


6 

5.546 

53.591 

- 

0.69986 

6 

7 1 


7 

5.939 

45,383 

- 

0.78145 

7 

6 i 


7B 

5,129 

45.383 

- 

0.78202 

5 

5 


8 

2.442 

16.335 

156 

0,97554 

3 

2 j 


9 

3,443 

25.543 

152 

0.95133 

4 

4 i 

7.6 

4 

2.186 

2*. 543 

153 

0.96331 


1 

• 

5 

3,465 

35.152 

154 

0.91769 


3 I 


6 

' n.082 

62.455 

- 

0.37068 


7 1 


7 

10.782 

54.966 

- 

0.57111 


6 


7B 

9.938 

54.966 

- 

0.57152 


5 ' 


3 

3,762 

17.413 

158 

0.95858 

3 

2 


9 

1 5.336 

27.228 

154 

3.91425 

4 

4 

1 


} 
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Plan 6. In all cases the smallest increase is obtained for Test Plan 4, followed 
by Test Plans 8, 5, 9, 7B, 7, and 6, which has the largest increase. 

The optimum component vibration levels for the 135 dB environment are lower than the 
baseline vibration levels in all cases. The amount of the decrease varies with the 
payload and test plan from 3.472 g rms for Payload 1,2 with Test Plan 8 to 27.762 g 
rms for Payload 1,2 with Test Plan 6. Except for Payload 1,6, the smallest decrease 
is obtained for Test Piar. 8, followed by Test Plans 4, 9, 5, 7, 7B, and 6, which has 
the largest decrease. For Payload 1,6 the amount of the decreases for Test Plans 4 
and 9 is reversed. 

The optimum component vibration levels for the 150 dB environment are higher than the 
baseline vibration levels in all cases. The amount of the increase varies with pay- 
load and test plan from 2.240 g rms for Payload 1,6 with Test Plan 8 to 15.060 q rms 
for Payload 7,6 with Test Plans 7 and 7B. No particular pattern is evident. For 
each payload the four smallest increases are obtained from Test Plans 4, 5, 8, and 9' 
and the three largest increases are obtained from Test Plans 6, 7, and 7B. 

The optimum asseir ' acoustic test levels for the 135 dB environment are lower than 
the baseline acou. levels in all cases. The amount of the decrease varies with 
the payload and test plan from 10 dB for Payload 1,2 with Test Plan 4 to 14 dB for 
Payload 7,6 with Test Plan 5. In all cases the smallest decrease is obtained for 
Test Plan 4, followed by Test Plans 8, 9, and 5, which has the largest decrease. 

The optimum assembly acoustic test levels for the 150 dB environment are higher than 
the baseline acoustic levels in all cases. The amount of the increase varies with 
payload and test plan and is either 5 or 7 dB. 
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A comparison of Tables 4-10 and 4-11 with Table 4-8 shows that variations in the 
environment also have the most significant effect on the reliability rankings. For 
the 135 dB environment there are five rank changes for Payloads 1,2, 1,6, and 7,2 
and three rank changes for Payload 7,6. For Payload 1,2 the rankings of Test Plans 
4, 6, 7, 7B, and 8 are affected; for Payloads 1,6 and 7,2, Test Plans 5, 6, 7, 7B, 
and 9; for Payload 7,6, Test Plans 6, 7, and 7B. For the 150 dB environment there 
are two rank changes for Payloads 1,2 and 7,2, four rank changes for Payload 1,6, 
and no rank changes for Payload 7,6. For Payload 1,2 the rankings of Test Plans 
4 and 8 are affected; for Payload 1,6, Test Plans 4, 5, 8, and 9; for Payload 7,2, 

Test Plans 5 and 9. For the 135 dB environment Test Plan 4 ranks first for all 
payloads, followed by Test Plans 8, 5, 9, 6, 7B, and 7, which has the lowest vibro- 
acoustic reliability. Except for Payload 1,6, for the 150 dB environment Test Plan 
4 ranks first, followed by Test Plans 8, 5, 9, 7B, 7, and 6, which has the lowest 
vibroacoustic reliability. For Payload 1,6 the rankings of Test Plans 4 and 8 are 
reversed. 

4.3.2 STS LAUNCH COST 

Two variations of the STS launch cost were considered. The first variation was $17.5Ii, 
which is $4.0M above the baseline value of $13. 5M; the second variation, $21. 5M, 
is $8.0M above the baseline value. The fourth digit of the six-digit case code 
identifies the STS launch cost. The case codes for the data of these variations are 
XYOlOO and XY0200 tor the $17. 5M and $21. 5M STS launch costs, respectively, where X 
is the test plan ID and Y is the payload ID defined in Section 3.1. The TECF and FFP 
data are given in the Addendum and the TECF data for the assembly test level at which 
the optimum cost occurs are shown in Figures 4-1 to 4-28. On the figures the symbols 
for these variations are ♦ and x for the $17. 5M and $21. 5M STS launch costs, respectively. 
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Summaries of the optimum data by payload are given In Tables 4-12 and 4-13 for the 
$17.5M and $21. 5M STS launch costs, respectively. 

A comparU'.n of Tables 4-12 and 4-13 with Table 4-8 shows the effect of these 
variations on the cost rankings. For both STS launch costs there are no rank changes 
for Payload 1,2 and two rank changes for Payloads 1,6, 7,2, and 7,6. For Payload 1,6 
the rankings of Test Plans 6 and 7 are affected; for Payloads 7,2 and 7,6, Test Plans 
6 and 7B. Except for Payload 1,6, Test Plan 4 ranks first, followed by Test Plans 5, 8, 
9, 7B, 6, and 7, which has the highest optimum cost. For Payload 1,6 the rankings of 
Test Plans 6 and 7 are reversed. 

The optimum expected costs for the two STS launch cost variations are higher than the 
baseline costs in all cases. The amount of the Increase varies with payload and test 
plan. For the $17. 5M STS launch cost the increase varies from $0.166M for Payload 1,2 
with Test Plan 4 to $1.193M for Payload 7,6 with Test Plan 6. For the $21. 5M STS 
launch cost the Increase varies from $0.328M for Payload 1,2 with Test Plan 4 to 
$2.343M for Payload 7,6 with Test Plan 6. 

The optimum component vibration levels for the two STS launch cost variations are 
the same or higher than the baseline vibration levels In all cases. The amount of the 
Increase varies with payload and test plan from 0 g rms to 9.575 g rms. No change In 
the vibration level occurs 15 times. For both variations the maximum change of 9.575 
rms occurs for Payload 7,2 with Test Plan 6. 

The optimum assembly acoustic test levels for the two launch cost variations ^rr 
the same or higher than the baseline acoustic levels In all cases. The amcunt jr tno 
Increase varies with payload and test plan and Is either 0 or 2 dB. 
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A comparison of Tables 4-12 and 4-13 wit!: Table 4-8 shows the effect of the STS 
launch cost variations on the reliability rankings. For the $17 5M STS launch cost 
there are four rank changes for Payload 1,2, two rank changes for Payloads 1,6 and 
7,2, and no rank changes for Paylo. J 7,6. For Payload 1,6 the rankings of Tost Plans 
4, 5, 8, and 9 are affected; for Pa'^loads 1,6 and 7,2, Test Plans 5 and 9. For the 
$21. 5M STS launch oost there are two rank changes for each payload. For Payload 1,2 
the rankings of Test Plans 4 and 8 are affected; for the othor payloads. Test Plans 
5 and 9. Except for Payload 1,2, for the $17.5f1 STS launch cost Test Plan 4 ranks first, 
followed by Test Plans 8, 5, 9, 7B, 7, and 6, which has the lowest vibroacorstic 
reliability. For Payload 1,2 the rankings of Test Plans 5 and 9 are reversed. Except 
for Payload 7,6, for the $21. 5M STS launch cost Test Plan 4 ranks first, followed by 
Test Plans 8, 5, 9, 7B, 7 and 6. For Payload 7,6 the rankings of Tes!: Plans 5 and 9 
are reversed. 

4.3.5 DEGREE OF REDUNDANCY 

Only one variation of the degree of redundancy in the housekeeping section of the 
payload was considered. This variation was double redundancy Instead of L!ie single 
redundancy of the baseline. The fifth digit of the six-digit case code identifies 
the degree cf redundancy. The case code for the data of this variation Is XYOOiu, 
where X is the test plan ID and Y Is the payload ID defined In Section 3.1. The 
TECF and FFP data are given In the Addendum and the TECF data for the assembly test 
level at which the optimum cost occurs are shown In Figures 4-1 to 4-28. On the 
figures the symbol for this variation is O .A summary of the optiminn daM by 
payload is given In Table 4-14. 
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Table 4-14 


Summary of Optimi'ms By Payload 
Variation 0010 
Phase C Double Redundancy 


Expected i ComDOnent 


Cost c 
(S X 10^) 



Vibration 
Test/Design 
Level 
(g rms) 


18.544 

28.99/ 

45.342 

32.94T 

32.b4b 

11.86C 

19 . 


c: 461 
32.94S 
58.539 
42.537 
42.537 
14.364 
22.461 


18.544 

28.997 

45.342 

32.948 

30,910 

11,860 

19,76/ 


19,767 

30.910 

54,917 

37,437 

37.^37 

12.642 

21.071 


Assembly 

Acoustic 

Ter: 

Level 

(dB) 





Associated 

Vibroacoustic 

Reliability 


0.99784 
u. 99617 
0.97750 
0.98060 
0.98132 
0.99726 
0.99524 


0.99641 

0.99302 

0.94992 

0.96120 

0.96190 

0.99559 

0.99165 


0.98497 

0.96159 

0.85661 

0.87574 

0.865-'’ 

0.9810 

0.95119 


0.97336 

0.92603 

0.68454 

0.71929 

0.71982 

0.96720 

0.94013 


Gfi 

.TV. 
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A comparison of Table 4-14 with Table 4-8 shows the effect of this variation on the 
cost rankings. There are two rank changes for Payload 1,2 and none for the other 
payloads. The rankings of Test Plans 6 and 7B are affected. Except for Payload 1,6, 
Test Plan 4 ranks first, followed by Test Plans 5, 8, 9, 6, 7B, and 7, which has the 
highest optimum cost. For Payload 1,6 the rankings of Test Plans 6 and 7B are 
reversed. 

The optimum expected costs are higher than the baseline costs in all cases. The 
amount of the increase varies with payload and test plan from $0.088H for Payload 
7,2 with Test Plan 4 to $0.867f1 for Payload 1,6 with Test Plan 7. Except for Payload 
1,6, the smallest increase is obtained for Test Plan 4, followed by Test Plans *>, 6, 

8, 9, 7B anu 7, which has the largest increase. For Payload 1,6 the amount of the 
increase for Test Plans 6 and 8 is reversed. 

The optimum component vibration levels are the same or lower than the baseline 
vibration levels in all cases. The amount of the decrease varies with payload and 
test pl.’.n from 0 g rms to 9.575 q rirs. No change in the vibr tion level occurs 5 
times. The maximum change of 9.575 g rms occurs for Payload 1,2 with Test Plan 6. 

The optimum assembly acoustic test levels are the same or lower than the baseline 
acoustic levels in all cases. The amount of the decrease varies with payload and test 
plan and is either 0 or 2 dB. 

A comparison cf Table 4-14 with Table 4-8 shov/s the effect of the degree of redundancy 
on the reliability rankings. Theie are two rank changes for Payloads 1,2, 1,6, and 
7,6 and four rank change's for Payload 7,2. For Payload 1,2 the rankings of Test Planj 
4 and 8 are affected; for Payloads 1,6 ard 7,6, Test Plans 5 and 9; for Payload 7,2, 
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Test Plans 5, 7, 7B, and 9. Except for Payloads 7,2 and 7,6, Test Plan 4 ranks first, 
followed by Test Plans 8, 5, 9, 7B, 7 and 6, which has the lowest vibroacoustic 
reliability. For Payload 7,2 the rankings of Test Plans 7 and 7B are reversed and for 
Payload 7,6 the rankings of Test Plans 5 and 9 are reversed. 

4.3.4 COMPONENT RETEST/REPAIR COST 

Only one variation of the component retest/repair cost was considered. This 
variation was a $15,000 component retest/ repair cost when a failure occurs during 
component testing, a $30,000 component retest/repair cost when a failure occurs during 
assembly testing, and a $40,000 component retest/ repair cost when a failure occurs 
during flight. The changes were considered as a group. The baseline considers a 
$15,000 cost when a failure occurs at any level. The sixth digit of the six-digit 
case code identifies the component retest/ repair cost. The case code for the data of 
this variation is XYOOOl , where X is the test plan ID and Y is the payload ID defined 
in Section 3.1. The TECF and FFP data are given in the Addendum and the TECF data 
for the assembly test level at which the optimum cost occurs are shown in Figures 
4-1 to 4-28. On the figures the symbol for this variation is T . A summary of the 

optimum data by payload is given in Table 4-15. 

A comparison of Table 4-15 with Table 4-8 shows the effect of this variation on the 

cost rankings. There are no changes. Test Plan 4 ranks first for all payloads, followed 
by Test Plans 5, 8, and 9; Test Plan 7 ranks last. For Payloads 1,2 and 1,6 Test Plan 
7B ranks fifth and Test Plan 6 ranks sixth. These rankings are reversed for Payloads 
7,2 and 7,6. 
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Table 4-15 



Summary of Optimums By Payload 
Variation 0001 

Phase C Component/Assembly/Flight Retest/Repair Cost = $15K/$30K/$40K 


Payload 

Test 

Flan 

Expected 

Cost 

(S X 10^) 

Component 
Vibration 
Test/Design 
Level 
(q rms) 

Assembly 

Acoustic 

Test 

Level 

.IdB] . 

Associated 

Vibroacoustic 

Reliability 

Cost 

Rank 

- 

Reliabilit>| 
Rank | 

! 

1 

1 

i 

1 .2 

4 

1.078 

23.942 

151 

0-99814 

1 

t 

1 i 


5 

1.505 

32.948 

147 

0.99646 

2 

3 ' 


6 

3.232 

54,917 

. 

C. 9801 8 

6 

7 1 


7 

3.310 

39.906 

- 

0.93436 

7 

6 1 


7B 

3.015 

39.906 

- 

0.98507 

5 

5 ! 


8 

1.806 

16.321 

151 

0.99775 

3 

2 ! 


9 

2.325 

22.461 

147 

0.99565 

4 

4 { 

1 16 

4 

1.356 

27.204 

153 

0.99677 

1 

1 • 


5 

1.838 

35.121 

151 

0.99562 

2 

3 1 


6 

5.085 

-3.539 

- 

0.94835 

6 

7 1 


7 

5.268 

48.333 

- 

0.96737 

/ 

6 


7B 

4.460 

48.333 

- 

0-9630% 

5 

5 ; 


8 

2.212 

18.544 

153 

0.99622 

3 

2 1 


9 

2. 770 

23.942 

151 

0.99490 

4 

4 1 

7,2 

4 

1.326 

22.461 

151 

C.9866C 

1 

1 

1 

1 ! 


5 

1.727 

30.910 

147 

0.97466 

! 2 

3 


6 

3 534 

51.520 

. 

0.87212 

5 

■7 


7 

4.417 

35.121 

. 

0.88493 

1 7 

6 


78 

3.620 

35.121 


0,38557 

6 



8 

2.305 

15.311 

151 

0,98384 

3 

^ 1 


9 

2.326 

21.071 


0.96877 

4 

4 i 

1 

7.6 

4 

1.870 

25.521 

151 

0,96333 

i 1 

1 I 


5 

2.503 

30.910 

149 

3.95009 

1 2 

3 


6 

6.204 

54.917 

_ 

0.68366 

5 

7 


' 7 

7.314 

42.537 

- 

0.76080 

i 7 

6 


7B 

6.501 

42.537 ' 1 

- . 

0.76135 

6 

5 


3 

3.491 

17.397 I 


0.956^6 

3 

2 


9 

4.276 

21.071 


0,94010 

4 

4 
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The optimimi expected costs are higher than the baseline costs in all cases. The 
amount of the increase varies with payload and test plan from $0.019M for Payload 
1,6 with Test Plan 9 to $0.396M for Payload 7,6 with Test Plan 6, Except for Poyload 
1,6, the smallest increase is obtained for Test Plan 5, followed by Test Plans 9, 

4, 8, 7, 7B a ' 6, which has the largest increase. For Payload 1,6 the amount of 
the increase foi Test Plans 5 and 9 is reversed and for Test Plan 8 it is larger 
than that of Test Plans 7 and 7B. 

The optimum component vibration levels are the same or higher t.ian the baseline vibration 
levels in all cases. The amount of the increase varies with payload and test plan from 
0 g rms to 6.178 q rms. No change in the vibration level occurs 13 times. The maximum 
change of 6.178 g rms occurs for Payload 7,2 with Test Plan 6. 

The optimum assembly acoustic levels vary with payload and test plan. For Payload 1,2 
with Test Plan 8 and Payload 7,6 with Test Plans 4 and 8 they are lower than the baseline 
acoustic levels. For Payloads 1,6 and 7,2 with Test Plan 5 they are higher than the 
baseline values. For all other cases they are the same as the baseline values. 

A comparison of Table 4-15 with Table 4-8 shows the effect of the component retest/ 
repair cost on the reliability rankings. There are two rank changes for Payloads 1,2, 
1,6, and 7,2 and no rank changes for Payload 7,6. For Payload 1,2 the rankings of 
Test Plans 4 and 8 are affected; for Payloads 1,6 and 7,2, Test Plans 5 and 9. For 
all payloads Test Plan 4 ranks first, followed by Test Plans 8, 5, 9, 7, and 6, which 
has the lowest vibroacoustic reliability. 


4.3.5 PARAMETER VARIATIONS CLOSURE 

In the above discussions of the effects of the variations of key paraineters it has 
been shown that the cost and vibroacoustic reliability rankings vary with the payload, 
test plan, and parameter variation. The cost rankings are summarized by payload in 
Table 4-16 and the vibroacoustic reliability rankings are summarized by payload in 
Table 4-17. In Table 4-16 only Test Plan 4 holds the same ranking for all cases. 

In Table 4-17 no test plan holds the same ranking for all cases. The sensitivity of 

the various parameters on the cost and reliability rankings is illustrated in Figure 
4-29. This figure shows histograms of the t-nkings for each test plan. These 
histograms consider the rankings of the test plans for 28 cases, seven conditions 
(baseline and six variations) of the four payload configurations. 

The cost histograms show that, for the majority of the 28 cases. Test Plan 4 ranked 
first. Test Plan 5 ranked second. Test Plan 8 ranked third. Test Plan 9 ranked fourth. 
Test Plan 7B ranked fifth. Test Plan 6 ranked sixth, and Test Plan 7 ranked seventli. 

The reliability histograms show that, for the majority of the 28 cases. Test Plan 4 

ranked first. Test Plan 8 ranked second. Test Plan 5 ranked third. Test Plan 9 ranked 
fourth. Test Plan 7B ranked fifth. Test Plan 7 ranked sixth, and Test Plan 6 ranked 
seventh. 
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Table 4-16 
Cost Rank Summary 
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Parameter Variation 1 
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Table 4-17 


Vibroacoustic Reliability Rank Summary 

























SECTION 5 
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CONCLUSIONS AND RECOMMENDATIONS 


5.1 CONCLUSIONS 


On the basis of this Phase C study the followino conclusions, regarding alternate 
vibroacoustic test plans for the four facility type Shuttle Spacelab payload con- 
figurations considered, are made for the revised baseline and parameter variations: 


1. Statistical decision models provide a viable method of evaluating the cost 
effectiveness and the associated test levels of alternate vibroacoustic test 
plans. The methodology modified herein provides a major step toward the 
development of a realistic tool to quantitatively tailor vibroacoustic test 
programs to specific payloads. Component redundancy and partial loss of 
flight data are considered. Most direct and probabilistic costs and incipient 
failures resulting from vibroacoustic ground tests are treated. The results 
obtained from the application of the models to facility type Shuttle Spacelab 
oayload configurations are rational and identify new low cost test plans, 
optimum costs and the associated component vibration and assembly acoustic 
test levels are obtained for each alternate vibroacoustic test plan. To 
interpret the results relative to a particular test plan and payload, the 
modeling simplifications must be considered. 

2, On the basis of minimizing the expected project cost, the vibroacoustic 
test plans evaluated for the baseline parameters had u.ie following rank; 

(1) Test Plan 4 using subassembly testing only 

(2) Test Plan 5 using system testing only 

(3) Test Plan 8 using component and subassembly testing 

(4) Test Plan 9 using component and system testing 

(5) Test Plan 7B usirio component and protoflight structure testing or 
Test Plan 6 using no testing 

(7) Test Plan 7 using component testing only 


The fifth ranking depended on whether the payload configuration had a single 
experiment or multiple experiments. 
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3. On the basis of the vibroacoustic reliability associated with the min^ ,um 
expected project cost, the test plans evaluated for the baseline parameters 
had the following rank: 


(1) 

Test 

Plan 

4 or 


Test 

Plan 

8 

(3) 

Test 

Plan 

5 or 


Test 

Plan 

9 

(5) 

Test 

Plan 

7B 

(6) 

Test 

Plan 

7 

(7) 

Test 

Plan 

6 

The 

first 

and 

third rankings varied with the payload configuration. 


4. For the test plans evaluated with the baseline parameters the highest 
vibroacoustic test levels occurred for the payload configuration having 

a single complex experiment while the lowest test levels occurred for the 
payload configuration having multiple less complex experiments. The vibro- 
acoustic reliability associated with the optimum ;ost was lower for the 
multiple experiment i-ayload configurations. 

5. For the vibroacoustic test plans evaluated with the parameter variations 

the lowest expected project costs and the associated test levels were obtained 
for the 135 dB shuttle payload bay internal acoustic environment. 

6. The most sensitive parameters of those varied in this study were the shuttle 
payload nay internal acoustic environment and the STS launch cost. 

7. Fnr the ?8 parameter variation ca.-'s considered for each test plan Test Plan 4 
ranked first most frequently in the cost ranking, followed by Test Plans 5, 

8, 9, 7B, 6, and 7. Test Plan 4 also ranked .rst most frequently in the 
reliability ranking, followed by Test Plans 8, 5, 9, 7B, 7, and 6. 

8. For the test plans evaluated with the shuttle payload bay internal acoustic 
environment varied the expected project cost and the associated vibroacoustic 
test levels increased when the environment level increased. 

9. For the test plans evaluated with the STS launch cost varied the expected 
project cost and the associated vibroacoustic test levels increased when 
the launch cost increased. 

10. For the test plans evaluated with the degree of redundanc> in the housekeeping 
components varieo the expected project cost increased but the associated 
vibroacoustic test levels decreased when the degree of redundancy increased. 
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There were five cases in which the component vibration level did not change 

I but there were only four cases in which the assembly acoustic level changed. 

Because of the lower test levels the associated vibroacoustic reliability 
decreased in all but four cases. 

} 11. For the test plans evaluated with the component retest/repair cost varied 

the expected project cost and the associated component vibration level 
increased when the component retest/repair cost increased. There were five 
cases in which the assembly acoustic level changed; three cases were lower 
and two were higher. 

12. The proof test of a flight structure designed with a moderate increase in 
safety factor was the most cost effective of the structural options con- 
sidered. The cost of performing component and protoflight structure testing 
was approximately $0.8 million less than the cost of performing component only 
testing. 

13. Relatively h^gh acoustic test levels should be used for assembly level test- 
ing. For Test Plan 4, which utilizes subassembly testing only and was the 
most cost effective test plan considered, the assembly test level associated 
with the optimum expected project cost was either 151 dB or 153 dB for the 
baseline variation. The assembly level test provides an effective method 
of locating marginal component designs because of the improved simulation of 
the flight environment, resulting in a reduced variation in the component 
environment. On the other hand, component testing is not as effect! /e since 
high vibration levels are required to achieve payload reliability, resulting 
in a significant increase in component development costs. 

14. i.'ie modification of the models to provide flight by flight failure probabilities 
gave a more accurate representation of the cumulative multiple mission damage. 
Although this study was restricted to ' 15 mission payload, this also gives us 
the mechanism to study the effects of thn number of missions on the evaluation 
of the vibroacoustic test plans. 

15. The inclusion of the cost of designing components to ’'ithstand higher vibration 
levels provided optimum expected project costs and the associated test levels 
for each test plan considered. 

16. For comparable test sequences the expected project costs obtained for this 
Phe.je C study were less than those obtained for the Phase B study, primarily 
because of the deletion of all test dedicacsd hardware. 
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5.2 RECOMMENDATIONS 

The following specific recommendations are made: 


1, As a result of the evaluation of the alternate vibroacoustic test plans 
for the revised baseline and parameter variations, the effects of other 
key parameters should be examined. These parameters include the follow- 
ing: 

(1) Fundamental to the developed methodology is the untested component 
strength distribution. The results of component testing on various 
spacecraft programs encompassing in excess of 300 components are used 
to determine the proportion of components which pass the component 
vibration tests as a function o'‘‘ the test level, A semiloq graph of 
the data is a straight line. The effects of this parameter on the 
vibroacoustic test plan evaluation should be examined by varying the 
slope of this line. 

(2) In the studies performed to date the number of components in the house- 
keeping section of the payload reliability model has been fixed at 16 
plus the structure. All payload configuration variations have been 
made by varying the number of experiments and the number of components 
in each experiment. It has been shown that the results are payload con- 
figuration dependent. The effects of variations in the number of house- 
keeping components should be investigated. 

v3) All data has been obtained for a 15 mission facility type payload. The 
payloads that will be carried on the shuttle have a wide variety of 
characteristics. One of these characteristics 1$ the number of missions 
that the payliad is planned to fly. Since the modified models can evaluate 
flight by flight failure probabilities, the effects of variations in this 
key parameter should be determined as soon as possible. 

(4) Costs of component, subassembly, system, and structure tests. 

4. It was demonstrated in the Phase C study that the expected project cost 
increases as the degree of redundancy is increased. A study should be 
initiated to determine whether the components that perferm certain functions 
could be moved from the housekeeping section, where redundancy is required, 
to the experiment section, where no redundancy is required. One consequence 
Of this move would be the requirement for more components, even though they 
are redundant, particularly for payloads with a reasonable number of ex- 
periments. A tradeoff between the cost of a larger number of nonredundant 
components and the cost of components with higher degrees of redum ^cy 
should be establ <shed. 

5. The current reliability model requires that each experiment has the same 
number of components. To provide greater flexibility in studying a variety 
of payloads, ways to modify this requirement sfiould be investigated, 
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The decision models should be applied to a variety of planned Shuttle 
Spacelab payloads to determine the optimum vibroacoustic test plan and 
guide their development, flajor emphasis should be placed on minii„izing 
cost. By quantitatively evaluating the cost effectiveness of alternate 
vibroacoustic test plans early in the conceptual design phase, requirements 
can be established for specific payloads which result in reduced development 
costs. This has been in't. .ed by applying the modified decision models to 
evaluate the seven vibroacoustic test plans of Phase C for a representative 
EVA', (Earth Viewing Applications Laboratory) payload. Reference 3. 

7. The evaluation of the alte’^nate vibroacoustic test plans for free flying 
shuttle payloads and payloads using expendible launch vehicles should he 
investigated. Because major changes to current pract-'ces are punned frr 
Shuttle Spacelab payloads, this type of payload shoult. be examined s.'on. 
However, the methodology is also applicable to current payloads and shutti- 
launched free flying payloads. Potential cost savings for these prylouds 
should be examine \ 

8. The feasibility of extending the methodology to include thermal -vacuum 
and other test environments should be considp;ed. 

S. In the process of develooing the methodolooy to craluate alternate v'bro- 
acoustic test plans during the Phase B and Phase C studies considerable 
computer coding has been written to generate the data obtained. In most 
case: these codes were written lo obtain data for a specific test plan. To 
become useful for evaluating a variety oT spec'’ic payload configurations, 

, these programs should be placed on produefion status. To achieve this status 
the computer codes for the test plans of both Phase B and Phase C should be 
reviewed, coordinated, optimized, and documented. Wider usage should be 
obtained by making the code compatible with the NASA-6SFC computer. The 
capability to plot selected data on the CALCOMP, or other, plotter should 
enhance the application of this methodology. 
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6-DIGIT CASE CODE 


1st DIGIT - TEST PLAN ID 

1 = TP-4, Test Plan 4 

2 = TP-5, Test Plan 5 

3 = TP-6, Test Plan 6 

4 = TP-7, Test Plan 7 

5 = TP-7B, Test Plan 7B 

6 = TP-8, Test Plan 8 

7 = TP-9, Test Plan 9 

2nd DIGIT - PAYLOAD ID 

1 =1,2, Payload 1,2 

2 = 1 ,6, Payload 1 ,6 

3 = 7,2, Payload 7,2 

4 = 7,6, Payload 7,6 

3rd DIGIT - SHUTTLE PAYLOAD BAY INTERNAL ACOUSTIC ENVIRONMENT ID 

0 = Baseline = 145 dB OA 

1 = 1st Variation = 135 dB OA 

2 = 2nd Variation = 150 dB OA 

4th DIGIT - STS LAUNCH COST ID 

0 = Baseline = $13,500,000 

1 = 1st Variation = $17,500,000 

2 = 2nd Variation = $21,500,000 

5th DIGIT - DEGREE OF REDUNDANCY IN HOUSEKEEPING SECTION ID 

0 = Baseline = Single 

1 = 1st Variation = Double 

6th DIGIT - COMPONENT/ASSEMBLY/FLIGHT RETEST/REPAIR COST ID 

0=Baselihe = $15,000/$15.000/$15,000 
1 = 1st Variation = $15,000/$30,000/$40,000 

NOTE: 4-DIGIT CASE CODE IS LAST FOUR DIGITS OF 6-DIGIT CASE CODE 


